Asynchronous Event-Based 3D Reconstruction From Neuromorphic Retinas
نویسندگان
چکیده
This paper presents a novel N-ocular 3D reconstruction algorithm for eventbased vision data from bio-inspired artificial retina sensors. Artificial restinas capture visual information asynchronously and encode it into streams of asynchronous spike-like pulse signals carrying information on e.g. temporal contrast events in the scene. The precise time of the occurence of these visual features are implicitly encoded in the spike timings. Due to the high temporal resolution of the asynchronous visual information acquisition, the output of these sensors is ideally suited for dynamic 3D reconstruction. The presented technique takes full benefit of the event-driven operation, i.e. events are processed individually at the moment they arrive. This strategy allows to preserve the original dynamics of the scene, hence allowing for more robust 3D reconstructions. As opposed to existing techniques, this algorithm is based on geometric and time constraints alone, making it particularly simple to implement and largely linear.
منابع مشابه
Event-Based 3D Motion Flow Estimation Using 4D Spatio Temporal Subspaces Properties
State of the art scene flow estimation techniques are based on projections of the 3D motion on image using luminance-sampled at the frame rate of the cameras-as the principal source of information. We introduce in this paper a pure time based approach to estimate the flow from 3D point clouds primarily output by neuromorphic event-based stereo camera rigs, or by any existing 3D depth sensor eve...
متن کاملA Motion-Based Feature for Event-Based Pattern Recognition
This paper introduces an event-based luminance-free feature from the output of asynchronous event-based neuromorphic retinas. The feature consists in mapping the distribution of the optical flow along the contours of the moving objects in the visual scene into a matrix. Asynchronous event-based neuromorphic retinas are composed of autonomous pixels, each of them asynchronously generating "spiki...
متن کاملBreaking the millisecond barrier on SpiNNaker: implementing asynchronous event-based plastic models with microsecond resolution
Spike-based neuromorphic sensors such as retinas and cochleas, change the way in which the world is sampled. Instead of producing data sampled at a constant rate, these sensors output spikes that are asynchronous and event driven. The event-based nature of neuromorphic sensors implies a complete paradigm shift in current perception algorithms toward those that emphasize the importance of precis...
متن کاملNeuromorphic Event-Based 3D Pose Estimation
Pose estimation is a fundamental step in many artificial vision tasks. It consists of estimating the 3D pose of an object with respect to a camera from the object's 2D projection. Current state of the art implementations operate on images. These implementations are computationally expensive, especially for real-time applications. Scenes with fast dynamics exceeding 30-60 Hz can rarely be proces...
متن کاملEvent-based silicon retinas and cochleas
This chapter reviews neuromorphic silicon retinas and cochleas that are based on the structure and opera on of their biological counterparts. These devices are built using conven onal chip fabrica on technologies, using transistor circuits that emulate neural computa ons from biology. In rst genera on sensors, the analog outputs of every cell were read out serially at xed sample rates. The new ...
متن کامل